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on Long Paths 

Yashar Ghiassi-Farrokhfal, Jorg Liebeherr, Almut Burchard 

Abstract 

We study how the choice of packet scheduling algorithms influences end-to-end performance on long network 
paths. Taking a network calculus approach, we consider both deterministic and statistical performance metrics. A 
key enabling contribution for our analysis is a significantly sharpened method for computing a statistical bound for 
the service given to a flow by the network as a whole. For a suitably parsimonious traffic model we develop closed- 
PsJ form expressions for end-to-end delays, backlog, and output burstiness. The deterministic versions of our bounds 

yield optimal bounds on end-to-end backlog and output burstiness for some schedulers, and are highly accurate for 
d end-to-end delay bounds. 

1—5 

I. Introduction 

^ Link scheduling algorithms for packet switches have been studied extensively, e.g., |fT9|, however, little is 

. known about the impact of link scheduling in large networks with long end-to-end paths. As a case in point, 
Q the packet dispersion of a CBR traffic flow at an overloaded First-in-First-Out (FIFO) link with cross traffic 
p3) is given by 

_ fin ^ 

jr fout — , ! 
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cn 

CSJ where C is the constant-rate link capacity, Tc is the arrival rate of CBR cross traffic, and r-m and rout, 
respectively, are the arrival and output rate of the traffic flow (with + rc > C). Considering a path of a 
^ large number of overloaded FIFO links (with homogeneous cross traffic and link capacities), the output rate 
T— I was shown in ||9jl to converge to 

> Tout — > [C - rc]+ , 

X 

where H is the number of traversed links and = max{x, 0}. This is the same output rate observed 
^ in a network with priority scheduling where cross traffic is given higher priority. Thus, the question arises 
whether the role of link scheduling diminishes on long paths in more general settings. 

This paper develops an analysis that can assess the impact of a broad class of link scheduling algorithms 
on end-to-end performance. Taking a network calculus approach fTTl, we characterize traffic in terms of 
envelope functions and service by service curve functions. We present bounds on end-to-end performance 
metrics for statistical, as well as worst-case assumptions on traffic. Our study considers all scheduling 
algorithms for which the transmission order of backlogged packets is entirely determined by the difference 
of their arrival times. These schedulers, referred to as A-schedulers, include FIFO, priority scheduling, 

Y. Ghiassi-Farrokhfal (yashar@comm.utoronto.ca) and J. Liebeherr ( jorg@comm . utoronto . ca) are with the De- 
partment of Electrical and Computer Engineering, University of Toronto. A. Burchard (almut Smath . utoronto . ca) is with 
the Department of Mathematics, University of Toronto. 

The research in this paper is supported in part by the Natural Sciences and Engineering Research Council of Canada (NSERC). 



2 



and deadline based scheduling. A key contribution of this paper is a significantly sharpened method for 
computing a statistical bound on the service given to a flow on an entire network path from statistical 
characterizations of the service at each node of the path. For traffic models that are characterized by a long- 
term rate and a short-term burst, we derive closed-form expressions for statistical and worst-case bounds on 
end-to-end delay and backlog. We evaluate the tightness of the bounds by computing performance metrics 
for specific adversarial arrival scenarios. In some cases, e.g., for backlog bounds for some of the considered 
schedulers, we are able to show that our bounds are optimal. 

The analysis in this paper is made possible by two advances in the network calculus. The first is a tight 
description of schedulers by service curves at a single nodes from |[14|. The second is presented here. We 
advance the state-of-the-art of the stochastic network calculus pO} by improving methods for concatenating 
statistical per- node service descriptions to achieve service descriptions for an entire network path. Compared 
to the best available methods [4, 14], we achieve significantly improved end-to-end performance bounds for 
many scheduling algorithms. For the special case of deterministic scenarios (i.e., where bounds are never 
violated), we recover worst-case end-to-end delay bounds known for FIFO networks |(8}[T2 1, while extend- 
ing these bounds to more complex scheduling algorithms. For FIFO scheduling, researchers have found 
conditions when the output of a node has similar characteristics as the input, justifying a decomposition 
analysis where each node can be analyzed in isolation |[T]|7 18 1. Our results indicate that the conditions for 



decomposition are often met in non-FIFO networks, as long as the scheduling in the network is sufficiently 
distinct from a network with strict priorities. 

Our study provides new insight into the role of scheduling algorithms in networks with long paths. For a 
network that is not permanently overloaded, we find that the differences between delay and backlog bounds 
at a single node persist in a multi-node setting. In fact, for the traffic and service models considered in this 
paper, the differences between bounds for various schedulers grow proportionally with the path lengths. 

The remaining sections of this paper are structured as follows. In Sec. |llj we discuss the probabilis- 
tic traffic and service characterization in the network calculus, with traffic envelopes and service curves, 
and present our result of a new network service characterization. In Sec. |lllj we describe the class of A- 
scheduling algorithms, and derive a network service description for a path of nodes with such schedulers. 



In Sec. IV we derive closed-form end-to-end bounds on backlog, delay and the burstiness of output from a 



network. In Sec. [Vj we derive lower bounds, thus enabling a discussion of the tightness of our results. We 



present numerical examples in Sec. VI and conclude the paper in Sec. VII 



II. Network Calculus Framework 

We take a network calculus modeling and analysis approach where arrivals and service of a flow are ex- 
pressed in terms of deterministic or probabilistic bounds, referred to as traffic envelopes and service curves, 
respectively [11|. We next discuss needed definitions and concepts of the deterministic and stochastic net- 
work calculus. The last subsection contains the key contribution of this paper: a new result to compute 
statistical service curves for a network path, that enables us to provide a sharpened analysis of end-to-end 
performance bounds. 
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A. Traffic Envelopes 

Consider a buffered link with a link scheduling algorithm, referred to as a node. Using a left-continuous 
time model, a sample path of the arrivals to the node in the time interval [0, t) is denoted by A{t). We 
assume that traffic arrivals can be described by a stationary random process, or at least satisfy stationary 
bounds. Traffic departing from a node in [0, t) is denoted by D{t). Both A{t) and D{t) are nondecreasing 
functions with ^4(0) = D{0) = 0, and we have D{t) < A{t) for all t > 0. For brevity, we use the notation 
A{s, t) = A{t) — A{s) and D{s, t) = D{t) — D{s) for arrivals and departures in the time interval [s, t) 

We characterize arrivals to a node in terms of bounds on sample paths. A deterministic sample path 
envelope E provides a worst-case description of traffic in the sense that it satisfies for all t > 

sup {A{s, t) - E{t - s)} < , (1) 

0<s<t 

with E{t) = if t < 0. By definition, traffic arrivals never violate a deterministic envelope. 

For a statistical network analysis we need a probabilistic analogue, i.e., a bound for all sample paths of the 
arrivals which may be violated with a small probability. A statistical sample path envelope Q is a. function 
that satisfies for all t > 

P( sup {A{s,t) -g{t- s;a)} > o) < e{a) , (2) 

where a represents one or several parameters, and e(cj) > is a bounding function. Further, Q(t\ o") = if 
t < 0. We can view e(cj) as a bound on the probability of violating the envelope. The notation Q(t\ cj) and 
e((T) indicate that both the envelope and the bounding function depend on the same parameter(s). Setting 
e(cr) = recovers a deterministic sample path envelope. 

For numerical evaluations and optimizations, we will use a parsimonious envelope characterization for 
traffic flows consisting of a rate parameter p > and a burst parameter o" > 0, such that for all s, t > 0, 

A{s,t)<p{t-s)^a. (3) 

A deterministic sample path bound for such an arrival characterization is given by the envelope E(i) = pt^o 
(for t > 0). This bound corresponds to the maximal output of a leaky bucket traffic regulator with rate p and 
burst size a. 

The probabilistic version of this bound takes the form that for all s, t > 0, 

V[A{s,t)-p{t-s)>a)<e(a), (4) 

which can be read as the probability that the arrivals violate a long-term rate p by more than a being bounded 
by e(cr). When we assume that e(cr) has an exponential decay, i.e., e(c7) = Me~°^" for given constants M 
and a, we obtain the Exponential Bounded Burstiness (EBB) traffic model [17], which is related to the linear 
envelope characterization by Chang [2|. We will write A ~ (p, a, Af ) to indicate that A is an EBB flow 
with parameters p, a, and M. The EBB model can express non-trivial processes, such as Markov-modulated 
On-Off processes |2|, but it does not apply to heavy-tailed or long-range correlated traffic. Extensions of the 



EBB traffic model have been proposed for bounding functions with faster than polynomial decay 1 16 1 and 



even heavy-tailed decay 1 13 1. 
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While a bound as in Eq. (|4]) is not a statistical sample path envelope (satisfying Eq. Q), such an envelope 
can be constructed with an application of the union bound For the EBB traffic model this yields a 
statistical sample path envelope 

g{t-a) = {p + j)t + a , e{a) = Me(^l + ^y-'"' (5) 

for any choice of 7 > 0, where 7 can be viewed as a rate relaxation. 

B. Service Curves 

We use the concept of a service curve fE) to describe a lower bound on the service available to a flow at a 
node or sequence of nodes. A node offers a deterministic service curve S, if the input-output relationship of 
traffic is such that for alH > 

D{t)> \ni {A{s)+S{t-s)} . (6) 

0<s<t 

The term on the right-hand side is referred to as min-plus convolution of A and S, and denoted by 'A*S\ 
Simple examples of service curves describe constant rate links, with S{t) = Ct, and latency -rate servers, 
with S{t) = [r{t — for suitable non-negative constants C, r, and d. 

A probabilistic extension of this concept leads to the formulation of a statistical service curve which 
satisfies for all t > that 

p(^D{t) <A*S{t;a)) <£{a), (7) 

where the violation probability and the service curve may depend on one or more parameters indicated by 
a. 

C. Performance Bounds 

The network calculus seeks to provide upper bounds on the delay, backlog, and output burstiness for a 
flow at a node or network path. For arrival and departure functions A and D, the backlog B{t) and the delay 
W{t) at time t are given by 

B{t) = A{t) - D{t) , 

W{t) = inf{s >0\D{t + s)> A{t)} . 

The backlog B and the delay W can be depicted, respectively, as the vertical and horizontal distance between 
the graphs of the arrival and departure functions. We use the term output burstiness to characterize a bound 
on the output process D. Bounds on the above metrics can be formulated using the min-plus deconvolution 
operator '0', which for any non-negative functions / and g is defined as f0g{t) = sup^>o{/(t+s) — 
For deterministic arrival and service characterizations, given by Eqs. ([T]l and ([6]), such bounds can be found in 
pT] ]. Below we provide the corresponding expressions for statistical arrival envelopes and service curves Q. 
The service curve definition in [4 J is not identical to that in Eq. Q. At the same time, the proof of the bounds 
are close enough to be omitted here. 
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Given a flow with a statistical sample path envelope with Q{t; ag) and eg{ag), and a statistical service 
curve with S{t;as) and SsicTs)- Then with bounding function 

£{ag,as) = eicTg) + e{as) , 

the following bounds hold for all s, t with < s < t. 



Output Burstiness: 



Backlog: 



P{D{s,t) >g(Z)S{t-s;ag,as)) <e(fTg,a,) ; 



P{B{t)>g0S{O;ag,as)) <e{ag,a,); 



Delay: 



where 



P{Wit) > d{ag,as)) <s{ag,as) ; 



d{ag, as) = min {s | Vt > : S{t + s; as) > Q{t; ag)} . 



Setting e(cjg, as) = yields the deterministic worst-case bounds of the deterministic network calculus. 

D. A New Convolution Theorem 

The main advantage of working with service curves is the ability to express the end-to-end service avail- 
able on a network path as a min-plus convolution of the service available at each node of the path. In the 
deterministic network calculus, if each node on a path of H nodes offers a service curve of 5/^ (1 < /i < H), 
a service curve for the entire path is given by 5nct = Si* S2* ■ ■ ■ * Sh- We refer to 5net as network service 
curve. 

Finding a network service curve in a statistical setting is difficult, and generally requires to introduce 



additional assumptions |10|. A main result of this paper is a novel convolution theorem for a statistical 
network service curve, which will enable us to create improved statistical end-to-end bounds for many 
scheduling algorithms. 

Theorem 1 (Network Service Curve) Consider a flow passing though a sequence of H nodes. Assume 
that at each node, the flow receives a statistical service curve Sh{t;ah) with bounding function £h{ah), 
where a^ is a single non-negative parameter. For each h < H, assume that the bounding functions satisfy 
the tail estimate 

poo 

/ £h{y)dy< 00, 
Jo 

and that the service curves are non-increasing in ah with 



Shit; cTh + y) > [Shit; ah) - y] 



(8) 



6 



Let Ti, . . . , th^i and 71, ... , 7^-1 be arbitrary positive parameters. Then, for the entire path, the flow is 
guaranteed the statistical service curve 



h<H 



Snet{t;a-i, ...,aH)= ;cri) * • • ■ *Sh(.-;o-h) * '^Eh<ffni(0 " J2 ^^'^ 
with bounding function 

1 /"°° 

enet(o-i, • • • , cfh) = £H{crH) + / eh{y) dy . 

^hTh J a. 



(9) 



h<H 

In the theorem, the function 5a is defined as 




5a{t) = { ' " ' (10) 



for a constant a > 0. The min-plus convolution of a function / with 5a corresponds to a right-shift of the 
function by a, that is, / * 5a{t) = f{t — a). 

In case of a deterministic bound, obtained by first setting eh(c) = for all a > a^, and then taking 
Th = 7h = 0, we recover the classical deterministic convolution result for composing a network service 
curve. 

The theorem above generalizes a convolution theorem from Q, by allowing more freedom in the con- 
struction of service curves. In f^, service curves have the specific form Sh{t; (Jh) = [Sh{i) — c"/i]+> but 
Q Theorem 1] performs the convolution of service curves only for the functions Sh{t), without the cr/i's. 
In contrast, the fi/i's enter into the convolution of Eq. (|9]). While carrying these parameters increases the 
complexity of the convolution, it yields network service curves that can more closely describe the behavior 
of certain schedulers. 

In appUcations, we will make specific choices for Th and 7/^ that simplify the computation. We will also 
choose o"! , . . . , cjh as explicit functions of a single parameter a. The impact of the new convolution on 



end-to-end delay computations is evaluated in Sec. VI 



Proof: We first show without using the assumption in Eq. ([8]), that a network service curve is given by 
Si...H{t;cFi, . . .,aH) = ^^mi^^^SH{xH;o-H) + ^ Sh(^Xh; (Th + Jh'^irk-i + x^)^^ , (11) 



h<H k>h 



where the infimum ranges over the set . . . , xh > | J2h<H + J2h<H ''"/i ^ ^^^^ the bounding 
function is as in the statement of the theorem. The claim follows from there by observing that Ylkyhi'^k-i + 
Xk) < t in the argument of Sh, and then using Eq. ([S]). 

To establish Eq. ( 1 1 1, we proceed by induction. For H = I, there is nothing to show. For H = 2 nodes, 
we need to show that 

Si2{t;ai,a2) = mi ^ 5'2(a:;2; 0-2) + (xi; ai + 7i(ti + X2' 



satisfies 



1 f°° 

P{D2it) < Ai* Si2it;ai,a2)} < e2ia2) + / £1(2/) + £2(^x2) =: £12(^^1, f^a) . (12) 

7in Ja^ 
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To see this, note that for every sample path where D2{t) > A2* S2{t; (T2), there exists exists a point X2 < t 
such that 

D2{t)>A2{t-X2) + S2{x2;a2). (13) 

If, additionally, 

\/x < t 3xi < X : Di{t — x) > Ai{t — xi — X — Ti) + Si{xi; ai + 71(2; + ti)) , (14) 
then, since A2 = Di, it follows that 

D2it)>Ai*Si2it;ai,a2). (15) 



We claim that the event in Eq. (15 1 occurs at least with probability 1 — ei2('7i, '72)- By definition, the 
probability that the event in Eq. ( 13 1 fails is bounded by 

PiD2it)<A2*S2it;a2))<e2{a2). 



To estimate the event in Eq. ( 14i, we discretize the time variable x by choosing an integer k > 1 such that 
{k — l)ri < X < kri. If Eq. ( 14 1 fails, then the monotonicity of Di, Ai, and Si implies that there exists a 
A; > 1 such that 

Di{t - kri) < Ai{t - xi - kri) + cri + 7x1) . 

We conclude with the union bound that Eq. ([14]) fails with probability at most 



00 

p(Di{t-kTi) < inf {Ai{t-xi-kTi) + Si{xi;ai + k-iiTi)]] 

k=0 

00 



k=l 



< 



71 Ti 



£i{y)dy. 



Eq. ([T2]l follows with another application of the union bound. 



For the inductive step, let H > 2, and assume that Eq. (Ill holds for every sequence of H — 1 nodes. 
Given H nodes, we first apply the inductive hypothesis to obtain for the last H — 1 nodes the service curve 

S2...H{t;cr2,...,crH) = inf \ SnixHlCTH) + ^ Sh(xh; ah + Ih'^iTk-i + Xk)) \ , 

^ l<h<H k>h ■' 

where the infimum ranges over |x2, ■ ■ ■ ,xh > Yl,h<H + Ylh<H ''"/i ^ *|' bounding function 

is 

1 f°° 

£2...Hicr2,- ■ ■ ,crH) = SHicrn) + / ^h{y)dy, 



l<h<H 



and then use the H = 2 case with S2...H and 62. ..h in place of ^2 and 82- 
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traffic A(^ 




c 



Fig. 1 

Buffered link with fixed capacity C and cross traffic. 



III. Networks of A-Schedulers 

In this section, we obtain a statistical network service curve that describes the service available on an 
end-to-end path of network Unks, where each link realizes a packet scheduling algorithm. To characterize 
link schedulers, we use a general description of scheduling algorithms, referred to as A-scheduling, recently 
developed in |14| . 

A. A-Schedulers 

Consider a buffered link with a fixed capacity of rate C and without buffer size constraints as shown 
in Fig. [T] We are interested in describing the performance of a (through) flow with arrival function Aq 
at this link. The flow experiences cross traffic from a flow with arrival function Ac- We do not assume 
independence of through and cross traffic. On the contrary, the traffic can be correlated in an adversarial 
fashion. A scheduling algorithm at the link determines the order of transmission of backlogged traffic. 

We consider the class of work-conserving scheduling algorithms whose operation can be entirely de- 
scribed by a set of constants Ajj where i and j indicate flow indices. For two backlogged packets pi and pj 
from flows i and j, the scheduler selects pi over pj for transmission, if pj arrives more than Ajj time units 
after pi. Schedulers that can be described in this fashion are referred to as /^-schedulers. Special cases are 
FIFO (Ajj = 0, Vi, j) and Static Priority (Ay = oo, if the priority of flow i is lower than that of flow j, and 
Ajj = — oo, if the priority of flow i is higher than that of flow j). A A-scheduler with non-zero but finite 
values of Ajj can be implemented by an algorithm that tags each packet arrival with a timestamp consisting 
of the sum of the arrival time and a flow-specific value (e.g., a target delay), and transmits packets in the 
order of timestamps. Here, the value of Ajj is the difference of the tags assigned to through and cross traffic. 
For example, the Earliest-Deadline-First can be realized by setting Ajj = d* — d^, where d* and d* are the 
a priori delay bounds of flows i and j. 

For any A-scheduler operating at a buffered link with capacity C where the cross traffic is bounded by 



a statistical sample path envelope given by Qdt; a) and edcr), it was shown in 1 14| that, for any choice of 
9 > 0, the function 



S{t;a)= Ct-gc{t-e + A{e);a) 



(16) 



is a statistical service curve with bounding function edcr), and /cxpr denotes the indicator function, with 
-^expr = 1 if the expression 'expr' is true, and /cxpr = otherwise. Also, A{9) = min{0, A}, where A 
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A[~ (pi, «/, Mj) Al~ (p2. 0(2, M^) 





Fig. 2 

Network path with cross traffic at each link. 



is the constant for the precedence of the through traffic with arrival function Aq relative to the cross traffic 
with arrival function Ac- (Note: We denote A = Aqc since we only work with the constant for arrivals Aq 
relative to Ac.) For a single node, the service curve characterization from Eq. (16^ was shown to yield a 
tight delay analysis, provided that cross traffic and through traffic are characterized by concave deterministic 
sample path envelopes p4| . 

B. A Network Service Curve for /^.-Schedulers 

We next apply Theorem 1 to construct a network service curve for A-schedulers along a network path as 
shown in Fig. [2j where the through flow traverses a tandem of H buffered links with A-scheduling, and with 
cross traffic. The arrivals of the cross flow and the A-scheduler can be different at each link. We use A'* 
to denote the constant of the A-scheduler at the h-th node. Arrivals to the cross flow at the /i-th node, A^, 
conform to an EBB model, as given by Eq. Q, with rate and exponentially decaying violation probability 

Inserting the statistical sample-path envelope for an EBB cross flow from Eq. ([5]) into Eq. ([16]), we obtain 
for the through flow at node h the service curve and the bounding function 



Sh{t;ah) = [Cht-\^{ph+l){t-eh+A^{9h))+ahjIt>e^^A^ 

Here, 7 > is an arbitrary constant. To simplify the computation of the convolution, we replace this service 
curve with the lower bound 



Shit; ah) = Cht - [{ph + l){t-eh + A''{9h)) + ^h,]- 



li 



t>eh- 



(17) 



The replacement comes without loss for A^ > 0, and a reduction by at most {Ch — Ph)[A^]~ for A'^ < 0, 
where we use = max{— j;, 0}. The key point is that the right hand side of Eq. ( [Tt] ) is concave and 
strictly increasing in t as soon as it is positive. We apply Theorem [T] with the free parameters set to 7/^ = 7 
and Th = — ^Tnet for /i = 1, . . . , if — 1, where Tnet and 7 are chosen below. By Eq. (9 1, 



Snet{t; a) = [Sl*---*SH* 5r,,^,{t) -{H- l)7t] + 

>[Si*---*Sh-{H- l)7t] , * 6r^Jt) - {H-l)-fTnet , 



(18) 
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where we use a to mean a = (cji, . . . , an)- To evaluate the term inside the square brackets in the second 
line, we may equivalently convolve the functions [Sh{t; a) — {H — 1)7^]+. For each of these factors, we 
write 

[Sh{t;ah) - {H-l)^t]^ = [{Ch - {H-l)^)t -[{ph+l){t-9h+^''{9h)) + (Jh]+]^It>e^ . (19) 
If we choose 9^ large enough so that 

{Ch - {H-l)^)9h - [{ph+l)l^''{9h) + <yh]+ > 0, (20) 



■■■Uh 



then we can re-write Eq. ([T9]l as 



with 



[Sh{t; ah) -{H- l)7t]+ = Sh * Se,{t) , 



Shit; ah) = mm{{Ch - {H-l)^)it + 9h), {Ch-ph-Hj)t + Uh} h 



i>0 - 



(21) 



Since each of the Sh is concave and strictly increasing in t, their convolution is given by the pointwise 
minimum 

Sr,et{t]a) := Si* . . .*SH{t;a) = min \Sh{t;ah)\ ■ 

h=l,...,H K ) 



Using the associativity and commutativity of the min-plus convolution, we obtain from Eq. ( [18) the network 
service curve 

5net(t; a) > (S'net * '^mot+Ef-i ^h) - - l)7rnet ■ (22) 

The bounding function is computed with Theorem [T] as 



+ 



7'^net 



h=l 



7 



A probabilistic network service curve for a cascade of A-schedulers has been computed in 1 14 1 by applying 
a convolution theorem for service curves from Q . This required to bring the service curves into the form 
Sh{t]ah) = [Sh{t) — ah\+, which resulted in a pessimistic service curve of the form 



Shit; ah) = Cht - iPh+l)[t -9h + A'^(0,O]+ - ah 



While the difference in the placement of ah compared to Eq. ( [17] ) may appear subtle, the evaluation in 
Sec. |Vl] will show that the service curve together with the new convolution theorem (Theorem [TJ results in 
substantially improved bounds. 
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IV. Output, backlog, and delay bounds 



In this section, we apply the performance bounds (from Sec. II-Cl with the network service curve for 



A-schedulers (from Sec. III-B I to a through flow that traverses a network as shown in Fig. [2] We will 



make choices for the free paiameters 6^ appearing in Eq. ( 16 1, so that we can obtain explicit bounds on the 
distribution of the output burstiness from the last node, the end-to-end backlog, and the end-to-end delay. 
The bounds apply to both deterministic (worst-case) and statistical assumptions. 



Consider the same network as described in Sec. Ill The through traffic is an EBB flow with arrival 



function Aq ~ (poi aoi ^o)- We assume that the stability condition 



holds, and choose 7 such that 



po < mill {Ch - Ph} 

h=l,...,H 



< Hj < mill {Ch - Ph} - Po ■ 

h=l,...,H 



To formulate the performance bounds, we need to introduce some more notation. Let 

"net = '^net = ^jnill^{Ch}, 



'net - 



h=0 



"netC'net 

H-1 



M.et = Moe(l + ^) + MHe(l + ^) + ^ ^ M,e(l + ^) , (23) 



and choose 



o"/i = '^o-, h = 0,...,H. 
ah 

For any given value of a, the smallest value of 9h that makes Sh{t) > for alH > (see Eq. ( [2T] )) is 
given by 

ft* - ru\n ! [ah + iph+jW%\ .... 

and the corresponding value for Uh is given by 

U*h = [ah + {ph + l)A'']-. (25) 

For the network in Fig. [2j let D^et denote the output of the through traffic from the last (H-th) node. Let 
Bnet{t) = -Dnet(i) — ^o{t) and Wnet{t), respectively, denote the total backlog and delay of the through 
traffic in the network of H nodes. 

Theorem 2 (Closed-form Bounds) With the above notation and definitions, the following bounds hold. 

• Output Burstiness: 



P(L'net(s,t) - {P0+I){t -S)> bnM) < M„ete" 



where 



12 



H 



bneticr) = ipo + H-/)Tnet + CTq + {po + 7) X] ' 



h=l 



End-to-end backlog: 



End-to-end delay: 



P(Bnet(t) > 6net(fT)) < M^ete""-*" ; 



where 



dnet((y) = Tnet + 



max < max< 
=i,...,/fl I 



ao + {H - l)7rnct do + {H - l)7r, 



net 



'h ■ 



h=l 



h=i,...,Hl L Ch-{H-l)j ' Ch-Ph-Hj 
The output bound shows that the departing traffic satisfies the EBB model. In the expressions for 6nct(c) 
and daet{(^), the second term quantifies the contribution of the through flow's burstiness to the delay at the 
bottleneck link, and the last term sums up the contributions of the burstiness of the cross flows. On long 
paths, i.e., for H large, the last term will dominate the second term. 

An important observation is that all bounds increase with A'^, and that the difference between end-to-end 
delay and backlog bounds for different schedulers grows linearly with the number of nodes. This clearly 
indicates that the impact of the scheduling algorithm on end-to-end performance bounds does not diminish 
on long network paths for these schedulers. 

In a discrete-time setting (where t = 0, 1, . . .), the bounds in the theorem hold with Tnet = 0, and with 



Eq. ( 23 1 replaced by 



M, 



Mo 



net 



+ 



Mh 



H-l 



1 _ g-ao7 1 — Q-o^Hl 



Mh 



^ (1 - e-"h7)2 • 



Proof: We insert the network service curve from Theorem 1 into the performance bounds from Sec. II- 
[C] Since OhTh < l/C'net, the bounding function evaluates to eo(o'o) + enet(<7) = Mnete . 

The backlog bound is given by 6net(o') = Go '2> S'not(O). For 9h > OJ^, we compute this deconvolution as 



^net(o-) =^0 ('S'net * Knct+T,h-i ^h) ~ i^-'^hTnet , (0) 
H 

< Go (rnct + J2^h) +iH - l)7rnet • 



(26) 



h=l 



In the first line, we have used our representation for the network service curve from Eq. ( [22| ). The key step 
is the second line, where we use that 5net is concave and Go is convex for t > 0, and that Goit) < "Snctit) 
for t is sufficiently large by the stability condition and our choice of 7. Plugging in 6h = 0^, we obtain the 
desired backlog bound. The same computation gives the bound on the output burstiness. 
We turn to the delay bound. For Oh > 0^, the delay bound from Theorem |2] is given by 



dnet(o-) = min{d > | Vt > : 5nct(i + d;a) > Goit; cro)} ■ 
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By Eq. (22 1, and using as above the concavity of 5nct and the stability assumption, we arrive at 

H 

dnet(cT) = Tnet + ^0h + min|x > | Snct{X) > + [H - l)7Tnet} • (27) 
h=l 

Expressing the function Snct in terms of the S^, we see that the minimum is assumed for 

Inserting Oh = 6*^ and Uh = ior h = 1, . . . , H completes the proof. ■ 

We note that 6h = 0^ is the optimal choice for the backlog and output bounds. To see this, observe that a 
selection in the range < Oh < 0^ decreases Sh, resulting in a smaller network service curve. On the other 
hand, from Eq. (26 1 it is apparent that 6net(o") increases for 0^ > 0^. We will see in the next section that the 



backlog bound is highly accurate, and in many cases tight. 

For the delay bound in Eq. ( [27] ), the optimal choice for Oh is not obvious, since Uh can be increased by 
taking 0^ > 0^, which may result in a smaller value for dnet{<^)- The choice Oh = O'^ is clearly suboptimal 
when Ch — Ph is small and the path is short, i.e., when the cross traffic consumes most of the bandwidth. 
In the case of a single node {H = 1) and deterministic arrival bounds, choosing Oi = dnet recovers known 
necessary and sufficient conditions for delay bounds e.g., |[5|. For long paths {H > 1 large), it is plausible 
that the choice Oh = 0*^, which is optimal for backlog and output, also leads to acceptable delay bounds. We 
will see in the next section that this is indeed the case. 

Stronger delay bounds than those stated in the theorem can be obtained by solving the following opti- 
mization problem: 

H 

minimize dnet(o-) = Tnet + ^ + ^ , (28) 

h=l 

subject to the constraints that X > and 

{Ch - {H-l)^){X + Oh) >ao + {H- l)7r„et , 
V/i : < (Ch-Ph- Hj)X + Uh>ao + {H- l)7Tnet , 



where Uh and are defined in Eqs. ( [20| ) and ( [24| ). This optimization problem is convex if all A are non- 
positive, but convexity does not hold if A'^ > for at least one node. Nevertheless, the problem is tractable, 
because the objective function is linear in the variables X and Oi, . . . , Oh- We will see in the evaluation that 
this optimization sometimes (i.e., for H small) improves the closed-form delay bound of Theorem [2] For 
FIFO networks (all A'^ = 0) and deterministic traffic (7 = Tnet = 0) the optimization recovers existing 
deterministic end-to-end delay bound for feedforward networks in (8] 12 1. 



14 



V. Tightness of End-to-end Bounds 

We now address the tightness of the bounds in Theorem [2] We consider the same network as in the 
previous section, but assume a deterministic context, where the arrivals of the through traffic and cross traffic 
at the h-th node satisfy the deterministic sample path envelopes EQ{t) = cto + pot and Eh{t) = cr/i + Pht 
(t > 0), respectively. We denote a deterministic sample path envelope for the departing through traffic at 
the H-th node by E^etit)- We obtain worst-case bounds by setting 7 = Tnct = in the expressions for 
in Eq. ([24]) and in Eq. ([25]l, yielding 



mm 



Ch — Ph Ch 
and 

Ul = [ah+PhA'']-. 

Also, setting 7 = Tnet = in Theorem |2] we obtain the following bounds, denoted by E*^^^, 6*g^, and d^g^. 
• Output BuRSTiNESS: 

H 



End-to-end backlog: 



End-to-end delay: 



h=l 
H 



blet = ^o + PoY.9l; (29) 



h=l 



dnet = max J max , 

h=l,...,H I ICh (^h — Ph 



do CTq-U^ ^ 
h=l 



For the special cases of priority scheduling where through traffic has lower priority (A'* = +cxd) or higher 
priority (A'^ = —00), we obtain 



Wnetit) < { 



H 

^0 . sr^ 



mm{Ch-ph} ^i^h-Ph 



_ mm{Ch} ' 

These bounds are known to be tight, which can be verified with elementary methods of the deterministic 



network calculus 1 1 1 1. 



In the remainder of this section, we evaluate the tightness of the bounds for A-schedulers with finite 
values of A. For this, we consider specific adversarial sample path scenarios for through and cross traffic, 
and compute the maximal observed end-to-end delay and backlog. For any specific arrival scenario, let 
^max = iiiaxt{i?nct(i)} and VFmax = maxt{Wnet(i)} denote the maximal end-to-end backlog and delay, 
respectively, of the through traffic. Clearly, any i?max and Wma.x, respectively, are lower bounds for the 
worst-case end-to-end backlog and delay. 
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Theorem 3 (Tightness of Bounds) For — oo < A'^ < oo, there exists a scenario of through and cross 
traffic that satisfies the assumptions stated above, such that 



H 



-Bmax > O'O + jOQ -Lfe , (31) 



h=l 

H 



with 



V^n^ax > . ° . +y,Lh, (32) 

mmh{Ch} ^ 



The theorem implies that the backlog bound in Eq. ^29\ is sharp when > for h = 1, . . . , H, and, in 
particular, for FIFO. For A'* < 0, observe that Eq. ( [33] ) implies that 

0<ei-L,<{l-^)[A'].. 

Here, the deviation 0^ — is due to the relaxation of the service curve in Eq. ([17]). The delay bound, 
although not sharp, describes actual delays in adversarial scenarios rather well, particularly on long paths. 
We conjecture that an optimal choice of the 6^ would result in a delay bound that is as good as the backlog 
bound. 

Proof: For the arrivals at the first node, we set 

Ao(t) = E^{t) . 

We time the cross traffic to have a maximal burst just before time t = 0, if A^ > 0, and just before t = A^, 
if A^ < 0, resulting in 

Al{t) = Ei{t + v-[A'y), 

where > is an infinitesimally small number. 

A careful analysis of the backlog from the cross flow at time t = [A^]_|_, yields that the first bit of the 
through flow experiences a latency of Li. We can construct similar scenaiios for cross traffic arrivals at 
subsequent nodes. For the /i-th node, we time the arrival of a cross traffic burst relative to the arrival of the 
first bit of through traffic, by setting 

h-l 

A;?(t) = E4i + z.-^Lfc-[A^]_). 

k=l 

Then, the initial latency of the through flow is increased at the /i-th node by Lh. It follows that the first bit 
of the through flow departs from the last node at time Ylih=i ^h, and so 

H 

h=l 
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proving Eq. p\\ . Now, consider the delay of the initial burst of the through flow. From the backlog analysis, 
we know that the first bit of the burst experiences a delay of Ylh=i ^h- Since the rest of the burst cannot be 
transmitted faster than at the rate of the slowest link, we obtain Eq. (|32|). ■ 



VI. Evaluation 

We present a numerical evaluation of the end-to-end bounds derived in this paper for deterministic and 
statistical arrival scenarios. We consider a network as in Fig. [2j where we assume for simplicity that all 
nodes have the same capacity of C = 100 Mbps and use the same A-scheduler. We use a discrete-time 
setting with a step size of 1 ms. The traffic arrivals of a flow follow an alternation of On and Off phases, 
where, in the On phase, a flow transmits at rate P = 1.5 Mbps, and the long term average arrival rate is 
/9 = 0.15 Mbps. The total traffic load at each node is set to 600 flows with A'^o = 10 through flows and 
Nc = 590 cross flows, resulting in a link utilization of 90%. 

For deterministic arrival scenarios, we characterize flows by a deterministic sample path envelope E{t) = 
pt + a. We choose the value of a such that the aggregate burstiness of all cross flows is 300 Kb, and likewise 
for the through flows. (Selecting equal burst sizes for aggregate through and cross traffic provides a good 
separation of our upper and lower bounds for worst-case end-to-end delays.) Note that the deterministic 
scenario does not account for statistical multiplexing, i.e., the burst size of N flows is times the burst of 
one flow. 

For statistical traffic, we assume that the arrivals of each flow are given by a discrete-time Markov- 
Modulated On-Off process, with an On state (= 1) and an Off state (= 0). The probabilities to change 
states are given by pi^o = 0.9 and po^i = 0.1. The EBB characterization for the aggregate through and 
cross traffic can be obtained using the effective bandwidth eb{a) from (e.g., ||3|, page 292), resulting in EBB 
parameters for the aggregate through traffic of po = NQeb{ao), Mq = 1, and ao selected to achieve high 
statistical multiplexing gain. The parameters for the cross traffic are chosen accordingly. 

We assume that the through flows are independent of each other, and that the cross flows are independent; 
however, through and cross traffic is not independent. Thus, we observe statistical multiplexing for the 
group of through flows and the group of cross flows, but not across the groups. 

For the discussion of the examples, recall that A = corresponds to FIFO, A = cxd to priority scheduling 
with low priority for through traffic, and A = — oo to priority scheduling with high priority for through 
traffic. 

A. Tightness of Delay Bounds 

We evaluate the tightness of our delay bounds for the deterministic arrival scenario described above. 
We compute the end-to-end delay bounds of the through traffic for different A-schedulers as a function of 



the number of nodes H. We present the closed-form delay bound d*^^ according to Eq. ( [30| ), the bound 
computed with the optimization according to Eq. p8| ) (with Tnct =7 = 0, since we are in a deterministic 
scenario), and the lower bound for the worst-case delay from Eq. ([32]). 

The results are shown in Fig. [3] The closed-form delay bounds track the bounds from the optimization 
very closely, and are virtually identical for long paths. Both upper bounds are highly accurate compared to 
the lower bound on the worst-case delay. Note that the differences between the delay bounds for different 
scheduling algorithms increase proportionally to the number of traversed nodes. Thus, in contrast to the 
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Fig. 3 

Deterministic end-to-end delay bounds of through traffic. 



scenario discussed in the introduction of the paper, we observe that the impact of scheduling is just as strong 
on long paths as on a single node. 

B. Improvement due to Theorem 1 

For the remaining examples, we use the statistical traffic scenario. We first evaluate the benefit our 
convolution result, by comparing statistical delay bounds computed with the previously best convolution 
result from Q, to the delay bounds obtained with the new convolution result in Theorem 1. The delay 
bound computation for A-schedulers with the convolution result from fT] uses an optimization, which is 
described in [14] . For delay bounds computed with Theorem 1, we evaluate the closed-form expression 
from Theoremjlj as well as the optimization in Eq. (28 1. We use a fixed violation probability of e = 10' 
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In Fig. [4| we show the end-to-end delay bounds of the through traffic for different A-schedulers for 
increasing path length. In all cases, the closed-form delay bounds are very close to the bounds obtained 
by the optimization. For A = oo, i.e., a priority scheduler where through traffic has lowest priority, the 
delay bounds obtained with the new convolution theorem give the same results as Q. Otherwise, the 
new convolution theorem results in dramatically improved delay bounds, especially for long paths. Our 
results clearly motivate the need for our new statistical network service curve expression for schedulers with 
A < oo. In fact, the delay bounds obtained with the 'old' convolution method for service curves show a 
similar growth rate for large H, thus, systematically underestimating the difference between schedulers. 
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C. Tail Bound of Backlog Distribution 

Fig. [5] shows the tail distribution for the backlog of the through traffic for a path of = 10 nodes. The 
graph shows that the backlog distribution divides the A-schedulers into two groups: one for large values of 
A, and one for small and negative values of A. In the first group, through traffic is treated effectively as 
low-priority traffic. The second group has a backlog distribution similar to FIFO (A = 0), indicating that 
this desirable property of FIFO scheduling extends to some non-FIFO algorithms. 

D. Burstiness Increase of Output Traffic 

Studying the burstiness of the output traffic further corroborates the findings of the previous example. 
Here, we compute bounds for the output of the through traffic for different choices of A and H, by applying 
the closed-form bound for D^ct from Theorem 2. 

In Fig. |6] we show the burst size of the output bound for a violation probability e = 10"^ in a bar chart. 
(The rate values are omitted since the long-term traffic rate does not change at the output of a link.) For 
comparison, the leftmost bar shows the burst of the through traffic arrivals at the first node. For large values 
of A, we see that the burstiness increases sharply. For values of A close to zero or negative, we observe 
only a modest increase of the burstiness at the output, even when the number of nodes is large. As a result, 
the arrival process at downstream nodes is not markedly different from that at the first node. Since modest 
increases of output burstiness are an important condition for a network decomposition analysis, e.g., see 
I? 18 1, our work suggests that conditions for decomposition may not be limited to FIFO networks. 
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Fig. 5 

Tail bound of backlog distribution (H = 10). 
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Fig. 6 

Burst size of output traffic (e = 10^^). 
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VII. Conclusions 

The analytical methods and closed-form expression developed in this paper vastly enhance available 
methods for end-to-end performance analysis in networks with deterministic and statistical traffic. With 
our analysis, it is now possible to make conclusive statements about the role of link scheduling in large 
networks. Contrary to conventional wisdom, we showed that the impact of Unk scheduling generally does 
not diminish on long network paths. We also shed light on a group of scheduling algorithms that provide 
service differentiation without the penalties of strict priority scheduling in terms of buffer requirements and 
deterioration of the burstiness of traffic. 
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